Stochastic optimal control — A concise introduction
نویسندگان
چکیده
<p style='text-indent:20px;'>This is a concise introduction to stochastic optimal control theory. We assume that the readers have basic knowledge of real analysis, functional elementary probability, ordinary differential equations and partial equations. will present following topics: (ⅰ) A brief presentation relevant results on analysis; (ⅱ) Formulation problems; (ⅲ) Variational method Pontryagin's maximum principle, together with backward equations; (ⅳ) Dynamic programming viscosity solutions Hamilton-Jacobi-Bellman equation; (ⅴ) Linear-quadratic problems, including careful discussion open-loop controls closed-loop strategies, linear forward-backward equations, Riccati equations.</p>
منابع مشابه
Quantitative Determination Of Optimal Fiscal And Monetary Policies: A Stochastic Optimal Control Analysis For Iran
متن کامل
Bayesian statistics: a concise introduction
In Bayesian statistics, probability is interpreted as representing the degree of belief in a proposition, such as “the mean of X is 0.44”, or “the polar ice cap will melt in 2020”, or “the polar ice cap would have melted in 2000 if we had not...”, etc. Thus we see it can be applied to reasoning about one time events (ice cap melting), counterfactual events (ice cap would have melted), as well a...
متن کاملStochastic optimal control theory
Control theory is a mathematical description of how to act optimally to gain future rewards. In this paper I give an introduction to deterministic and stochastic control theory; partial observability, learning and the combined problem of inference and control. Subsequently, I discuss a class of non-linear stochastic control problems that can be efficiently solved using a path integral. In this ...
متن کاملPathwise Stochastic Optimal Control
This paper approaches optimal control problems for discrete-time controlled Markov processes by representing the value of the problem in a dual Lagrangian form; the value is expressed as an infimum over a family of Lagrangian martingales of an expectation of a pathwise supremum of the objective adjusted by the Lagrangian martingale term. This representation opens up the possibility of numerical...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematical Control and Related Fields
سال: 2022
ISSN: ['2156-8499', '2156-8472']
DOI: https://doi.org/10.3934/mcrf.2020027